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Iteration of randomly chosen quadratic maps defines a Markov 
process: Xn+i = en+iXn{l — Xn), where Sn are i.i.d. with values in 
the parameter space [0,4] of quadratic maps Fg{x) = 9x{l — x). Its 
study is of significance as an important Markov model, with appli¬ 
cations to problems of optimization under uncertainty arising in eco¬ 
nomics. In this article a broad criterion is established for positive 
Harris recurrence of 

1. Introduction. The present article explores the problem of stability in 
distribution of randomly perturbed dynamical systems of random composi¬ 
tions of the form 

(1-1) Xn = Fs„F^^_^---FsiXo, n>l, 

where n > 1, is an i.i.d. sequence with values in the parameter space [0,4] 
of the quadratic map Fg{x) = 6x{l — x), and Xq is independent of {Sn ■ n > 
1}. To exclude the trivial invariant probability (5{o}) we will restrict the state 
space of the Markov process to S' = (0,1). By stability in distribution we 
mean the convergence in distribution of 4 dy) to the same limit 

TT[dy) for every initial state x G S, with denoting the n-step transition 
probability of {A„:n > 0}. Then vr is the unique invariant probability of 
this Markov process. 

One may, more generally, consider a stationary ergodic sequence ^ n > 
1}, rather than an i.i.d. one. For some results in this direction we refer to 
Anantharam and Konstantopoulos (1997). Our motivations for using the 
present framework are briefly stated below. 

We mention one particular application from economics that has provided 
at least a part of the motivation for this work. Consider a dynamic opti¬ 
mization problem in which one is given a ^‘'production function” f: M_|_ —> R+ 
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and a welfare function x A—where ^ is a parameter set, say 

A = [1,4], parametrizing a family of economies. For an initial x > 0, a pro¬ 
gram > 0, is a sequence such that 0 < xq = x < < /(x„_i). The 

consumption sequence {cn :n > 1} is defined as Cn = /(xn-i) — Xn- Given a 
discount factor 5 > 0 and a parameter value 9, one wishes to hnd an optimal 
program {xn:u>0}, xq = x, which maximizes Yl^=Q^^w{xn,Cn+i,9) over 
all programs {xn'-n > 0} starting at xq = x. Under economically feasible 
assumptions one may find / and w such that an optimal program is given 
recursively by x^+i = 0x^(1 — x„),x € [0,1] [Majumdar and Mitra (2000); 
also see Bala and Majumdar (1992) for a special case]. That is, the optimal 
program is given by the trajectory of the dynamical system Fg with initial 
state X. Since “uncertainty” is inherent in economic systems, one may thus 
obtain a randomly perturbed quadratic system. Alternatively, one may at 
the outset consider a stochastic dynamic programming problem and directly 
arrive at a stationary optimal policy leading to an evolution of states of the 
form (1.1) [Mitra (1998)]. 

For earlier work on the existence of a unique invariant probability of the 
process (1.1) when the distribution of has a two-point support or, more 
generally, may not have a density component, see Bhattacharya and Majumdar 
(1999), Bhattacharya and Rao (1993), Bhattacharya and Waymire (2002) 
and Carlsson (2002). Since {X^,} is then generally non-Harris or nonirre- 
ducible, fairly strong restrictions on the distribution of Sn are needed to 
ensure uniqueness of the invariant probability. The question of Harris recur¬ 
rence of the process (1.1) was raised by Athreya and Dai (2000). 

For ease of reference, we recall that a Markov process on (5, S), or its 
transition probability p(x, dy), is irreducible if there exists a nonzero cr-hnite 
measure tp such that 

OO 

(1.2) [/(x,H):=^p(’")(x,H)>0 Vx G 5 if (/?(H) > 0. 

n=l 

In this case one also says that the Markov process is p-irreducible. A p- 
irreducible Markov process is Harris recurrent, or p-recurrent, if 

(1.3) U{x,B) = oo y X ^ S if p{B) > 0. 


A (^-irreducible Markov process is said to be Harris positive if it has an 
invariant probability vr. It is known that a Harris positive process is Harris 
recurrent [Meyn and Tweedie (1993), Proposition 10.1.1]. Therefore, one 
may call the process Harris positive recurrent in this case, or Harris ergodic. 
The invariant probability measure vr of a Harris positive (recurrent) process 
is unique and one has the convergence of the Caesaro mean in total variation 
distance, 


(1.4) 


sup 


1 "■ 

-^p(-)(x,H) 

n 1 

m=l 


-k{B) 


0 


as n —> OO V X G 5. 
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In our present content irreducibility is proved with the help of Lemmas 
2.3 and 2.4. A tightness assumption does the rest. A verifiable sufficient 
condition for tightness due to Athreya and Dai (2000) then yields the useful 
Corollary 2.2. 

Before concluding this section, let us mention that our goal is to derive 
Harris positive recurrence of the process (1.1) under as broad a (verifiable) 
condition as we can muster. That this task is rather delicate is perhaps ev¬ 
ident from Remark 2.4. In addition to the economic application mentioned 
above, another motivation for this work comes from a program proposed 
originally by Kolmogorov for the approximate computation of the physi¬ 
cally meaningful ergodic invariant probability of a dynamical system. Note 
that a chaotic dynamical system has infinitely many extremal, or ergodic, 
invariant probabilities (including one uniform distribution on each of its in¬ 
finitely many periodic orbits). The problem is to approximate the invariant 
probability to which most points are attracted. Kolmogorov had proposed 
that one introduce a small random (possibly absolutely continuous) pertur¬ 
bation to the dynamical system, such that the resulting Markov process has 
a unique invariant probability, which is an approximation to the so-called 
Kolmogorov measure of the dynamical system [see Kifer (1988) and Katok 
and Kifer (1986)]. In our context this may be achieved, for example, by 
having a uniform density on a small interval around a parameter point of 
interest. Extensive simulations have shown that, for the present case, this 
program works not only for the chaotic regime, but also for 0 such that Fg 
has a stable periodic orbit, or a quasi-periodic attractor. These simulations 
may be found in Bhattacharya and Majumdar (2002). 

2. Harris recurrence and ergodicity. On the state space S = (0, 1), con¬ 
sider the Markov process defined recursively by 

(2.1) n = 0,1,2,..., 

where {sn-n > 1} is a sequence of i.i.d. random variables with values in 
(0,4) and, for each value 9 G (0,4), Fg is the quadratic function (on S): 

(2.2) FgX = Fg{x) = 9x{l — x), 0<x<l. 

As always, the initial random variable Xq is independent of {sn-n > 1}. 
Our main result provides a criterion for Harris recurrence and the existence 
of a unique invariant probability for the process {Xn : n > 0}. Recall that a 
sequence Hn, n>l, of probability measures on S is said to be tight if, for 
every e > 0, there exists a compact C S such that iJ,n{K^) > 1 — e for all 
n > 1. 

Let p{x,dy) denote the (one-step) transition probability of {A„:n > 1} 
and p^'^\x,dy) the corresponding m-step transition probability. 
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Theorem 2.1. Assume that the distribution of £i has a nonzero abso¬ 
lutely eontinuous eomponent [w.r.t. Lebesgue measure on (0,4)] whose den¬ 
sity is bounded away from zero on some nondegenerate interval in (1,4). If, 
in addition, > 1} is tight on S = (0,1) for some x, 

then: 

(i) {Xn : n > 0} is Harris recurrent and has a unique invariant probability 

(ii) converges to vr in total variation distanee, for ev¬ 
ery X, as n —> oo. 

Corollary 2.2. Ifsi has a nonzero density component which is bounded 
away from zero on some nondegenerate interval contained in (1,4) and if, 
in addition, 

(2.3) £'logei>0 and log(4 — ei)| < oo, 

then {Xn-n > 0} has a unique invariant probability tt on S = (0,1) and 
(l/N) dy) —HT in total variation distance, for every x G (0,1). 

Note that if the support of the distribution Q of is contained in [/r, v ], 
where 1 < /x < z/ < 4, then [a,b] = [min{l — i,F^(^)}, j] is an invariant in¬ 
terval for the Markov process (2.1) [see Bhattacharya and Rao (1993) and 
Bhattacharya and Waymire (2002)]. Since the transition probability has the 
Feller property, whatever be Q, there exists an invariant probability with 
support contained in [a,b] C (0,1). The result of Athreya and Dai (2000) is 
an important generalization of this. 

We will need some lemmas for the proof of this theorem. 

Remark 2.1. Note that the tightness condition in Theorem 2.1, guaran¬ 
teed, for example, by (2.3), cannot be dispensed with. It has been shown by 
Athreya and Dai (2000) that if F^logei < 0, then Xn converges in probability 
to 0. 

Lemma 2.3. Suppose the distribution Q of £i on (0,4) has a nonzero 
absolutely eontinuous component (w.r.t. Lebesgue measure A) whose density 
h{9) is bounded away from zero on an interval [c,d], 1 < c < d < A. Then 
there exist a nonempty open interval J C (0,1), a number 6 > 0 and a positive 
integer m such that 

(2.4) inf (x, B) > SX(B) V Borel B C J. 

x£j 

Proof. First assume Q is absolutely continuous with a continuous den¬ 
sity h. Let 00 G (1, A) be such that h(6o) > 0 and has an attractive 
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periodic orbit of period m. Such a point 9q exists, since the set of points 
6 for which Fg has an attractive fixed point or an attractive periodic orbit 
is dense in (0,4), by a result of Graczyk and Swiatek (1997). The n-step 
transition probability density is continuous in {x,y) and is given recursively 
by 


p{x,y) =p^^\x,y) = 


1 


-h 


x{l — x) V2:(l ~ x) 


(2.5) p('^+^){x,y)= f —^ 

7(0,1) ^(1 - z) \z{l-z)J 

x,y£ (0,1),re> 1. 


Let {xq,xi, ... ,Xm-i\ be the attractive periodic orbit of Fg^ :Fg^Xi-i = 
Xj, i = 1,..., m, Xm = xq. Then 


( 2 . 6 ) 


p^^\xi-l,Xi) = 


1 


-h 


Xi_i{l-Xi_i) VTi_l(l -Xi_i) 

HOo) 

-- .>0, l<i<m, 

Xi-l{l - Xi-l) 


since Xi = 9QXi-i{l — Xi-i) = Fg^Xi-i. By (2.6) and the continuity of (x, y) 
p^^\x,y), there exist <5* > 0 such that 


givi, ■ ■ • ,2/m-i) ■=p^^Hxo,yi)p^^\yi,y2) ■ • ■p^^\ym-2,ym-i)p^^\ym-i,xo) 
>0 yyi€[xi-6i,Xi + Si],l<i<m-l, 

so that 

(2.7) p(™^(xo,xo)> J ■■■ J g{yi,...,yyn-i)dyi---dym-i>0, 

where the integration is over the rectangle [xi — (^i,xi + Ji] x • • • x [xm-i — 
6m-i,Xm-i + dm-i\- By the continuity of (x,y) p^'^\x,y), it follows that 

there exists an open neighborhood J of xq such that 

(2.8) p*'™'^(x,y) > 5 > 0 \/x,y€J, 


where J is the closure of J in (0,1). This proves (2.4) assuming that Q 
is absolutely continuous with a continuous density. In the general, case let 
I C (1,4) be a nondegenerate closed interval such that h{9) >6'>0y9€F 
There exists a nonnegative continuous function h on (0,4) such that h{9) > 
0 V0 G interior of I, and h{9) < h{9) G (0,4). Define p^'^\x,y) in place 
of p^^\x,y), re > 1, in (2.5) by replacing h by h. Let 9q be a point in the 
interior of I such that d^9o has an attractive periodic orbit of period rre, say, 
{xo,xi,..., Xm-i}- Then the same argument as given above shows that there 
exists an open neighborhood J of xq such that p^'^\x,y) >5 Vx,y G J, for 
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some 5 > 0. Since h>h, (x, y) > {x,y) >6 Vx,y € J, and the proof 

of (2.4) is complete. □ 

Our final lemma adds greater specificity to Lemma 2.3 and to the proof 
of Theorem 2.1. 


Lemma 2.4. Assume the hypothesis of Lemma 2.3. There exist 71 , 72 , 
c < 7 i < 72 < d, and m>l sueh that: 

(a) Fq has an attractive periodic orbit of period m for every 6 € ( 71 , 72 ), 
and 

(b) if q{6) denotes the largest point of the attractive periodic orbit of 
Fg{6 G ( 71 , 72 )); then there exists an open interval J C (0,1) for which: 

(i) (2.4) holds, 

(ii) q{6) G J Vd G ( 71 , 72 ); 

(hi) 6 ^ q{9) is a diffeomorphism on ( 71 , 72 ) onto J. 


Proof. As in the proof of Lemma 2.3, let Oq G (c, d) be such that Fg^ 
has an attractive periodic orbit of some period, say, m. Apply the inverse 
function theorem to the function [9,x) —> F^x — x in a neighborhood of 
{9o,q{9o)). For this, note that 


(2.9) 




9=9o,x=q{9o) 


< 0 , 


in view of the property |^-^^3^U=q(6»o) < ^ [since q{9o) is an attractive hxed 
point of F^]. Hence there exists 9<9o<9 such that 9 —> q{9) is a diffeo¬ 
morphism on (9,9) onto an open interval I C (0,1). Now apply Lemma 2.3 
to hnd an open interval J = (^ 1 , 1 / 2 ) C I,ui < (?(do) < ^ 2 , such that (2.4) 
holds, and let 7 ^ = q~^{ui), i = 1 , 2 . □ 


Proof of Theorem 2.1. Let tt be an ergodic (i.e., extremal) invariant 
probability on 5" = (0,1), which exists by the assumption of tightness. We 
will first show that vr(J) > 0 for the set J in Lemma 2.4. Fix x G (0,1). 
There exists a point in the interval (F^^XjPyjx) which is attracted to the 
(attractive) periodic orbit of P 90 , where 9q is as in the proof of Lemma 2.4. 
Note that, outside a set of Lebesgue measure zero, every point of (0,1) is so 
attracted [see, e.g.. Collet and Eckmann (1980), page 13]. Thus there exist n 
and 0°, ^ 2 ! • • •; ^ ( 71 ; I 2 ) such that FqoFqo ■ ■ ■ Fgox G J. Consider the open 
subset of (0,1) X ( 71 , 72 )"' given by {{y,9i,92,... ,9n): Fg^Fg^ ■ ■ ■ Fg^y e J}. 
Since (x, 9i, 9^,. .., 9^) belongs to this open set, there exists a neighborhood 
of this point, say, ( 2 / 1 , ^ 2 ) x ( 6 'ii,di 2 ) x • • • x (dni,dn 2 ) C (0,1) x ( 71 , 72 )" such 
that V (y, 01,..., 9n) in this neighborhood, Fg^Fg.^ ■ ■ ■ Fg^y G J. This implies 
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that, for every initial state y G (^ 1 ,^ 2 ) = Ix, say, the probability that in n 
steps the Markov process will reach J is at least c”(0i2 — ^ 11 )■•• {Gn2 - ^nl) — 
en{x) > 0, where ci := inf{/i(0) :6 €[c, d]}. Now choose x such that it belongs 
to the support of it. Then tt{Ix) > 0 and, with n = n{x) as above. 


( 2 . 10 ) 


f f v^'^\y,J)TT{dy) 

J Jl^ 

> Sn{x)TT{Ix) > 0 . 

Also, by Lemma 2.3, 

(2.11) tt{B) > J p^'^\x,B)TT{dx) > 5 X{B)tt{J) VBorel B C J. 

In particular, vr has an absolutely continuous component on J w.r.t. Lebesgue 
measure, with a density bounded below by 5tt{J) > 0. Since the same argu¬ 
ment would apply to every invariant ergodic probability tti , and two distinct 
extremal invariant measures are mutually singular, it follows that vr is the 
unique invariant probability. 

Since we have argued above that for every x G 5 = (0,1) there exists 
n = n[x) such that J) > 0, we get, using (2.4), 

p(”+™)(x,S)> f p^^\z,B)p^^\x,dz) 

>6X{B)p^^\x,J) 

>0 Vxg5=(0,1), V.BC J,A(.B)>0. 

Hence the Markov process is irreducible with respect to the measure 4>{B) := 
X{B n J),B Borel C (0,1). From the standard theory for Harris processes 
[see, e.g., Meyn and Tweedie (1993), Proposition 10.1.1, page 231], it now 
follows that the Markov process (2.1) is positive Harris recurrent. Part (ii) 
of Theorem 2.1 is a consequence of this fact [see, e.g., Meyn and Tweedie 
(1993), Theorem 10.1.1, page 230, and Orey (1971)]. □ 


Remark 2.2. Under the hypothesis of Theorem 2.1, the Markov process 
is not in general aperiodic. For example, one may take the distribution of 
to be concentrated in an interval such that, for every 0 in this interval, Fq 
has a stable periodic orbit of period m > 1. As may be seen from Lemma 2.4, 
one may find an interval of this kind so that the process is irreducible and 
cyclical of period m. If has a density component bounded away from 
zero on a nondegenerate interval B containing a stable fixed point, that is, 
B n ( 0 ,3) 0, then the process is aperiodic and p^'^\x, ■) converges in total 

variation distance to a unique invariant vr. Restrictive assumptions of this 
kind have been used by Bhattacharya and Rao (1993) and Dai (2000). 
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Remark 2.3. In the course of the proof of Theorem 2.1, we showed 
that there exists an open interval J which is recurrent. An alternative way 
to complete the proof, in presence of Lemma 2.3, would then be to prove 
that J is positive recurrent in the sense that supjSrj :x € J} < oo. Here 
Tj := inf{n > I'.X^ G J\xq = x}. Under our general assumption, this last 
task appears elusive, compared to the route via irreducibility. 

Remark 2.4. We do not know if the conclusion of Theorem 2.1 re¬ 
mains valid under the assumption “the distribution Q (of ei) on (0,4) has a 
nonzero absolutely continuous component with respect to Lebesgue measure 
on (1,4),” in addition to (2.3). Note that such a Q may assign its entire mass 
on the set of all 6 for which Fg is chaotic. 

Acknowledgment. The authors wish to thank the referee for valuable 
suggestions. 
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